Sequentially processing data in a cached data storage system

ABSTRACT

The disclosure relates to sequential performance of a cached data storage subsystem with a minimal control signal processing. Sequential access is first detected by monitoring and examining the quantity of data accessed per unit of data storage (track) across a set of contiguously addressable tracks. Since the occupancy of the data in the cache is usually time limited, this examination provides an indication of the rate of sequential processing for a data set, i.e., a data set is being processed usually in contiguously addressable data storage units of a data storage system. Based upon the examination of a group of the tracks in a cache, the amount of data to be promoted to the cache from a backing store in anticipation of future host processor references is optimized. A promotion factor is calculated by combining the access extents monitored in the individual data storage areas and is expressed in a number of tracks units to be promoted. The examination of the group of tracks units and the implementation of the data promotion and demotion (early cast-out) is synchronized which results in a synergistic effect for increasing throughput of the cache for sequentially-processed data. A limit of promotion is determined to create a window of sequential data processing.

This application is a division of 068,857 filed July 2, 1987 now U.S.Pat. No. 4,882,642.

DOCUMENTS INCORPORATED BY REFERENCE

U.S. Pat. No. 4,414,644 shows a commanded sequential caching mode.

U.S. Pat. No. 4,464,713 shows a cache addressing apparatus.

U.S. Pat. No. 4,466,059 shows a random access caching mode.

U.S. Pat. No. 4,583,166 shows a so-called roll mode of accessing dataareas on a rotating record disk.

U.S. Pat. No. 4,262,332 shows a define extent control for use with thepresent invention.

U.S. Pat. No. 4,500,954 shows an implicit cache bypass for transferringdata between a host processor and DASD.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to data storage subsystems which areattachable to host processors, particularly those data storagesubsystems employing a cache (fast access data storage portion)interposed between the host processors and a backing store. Typically abacking store is a disk recorder, such as a magnetic or optical diskunit.

2. Discussion of the Prior Art

Peripheral data storage hierarchies have been used for years forproviding an apparent store as suggested by Eden et al in U.S. Pat. No.3,569,938. Eden et al teach that in a demand paging or request system,caching data in a high-speed front store (also termed a buffer) can makea peripheral data storage subsystem appear to have a large data storingcapacity yet provide for more rapid access to data than would beprovided by a usual backing store, such as a disk recorder. Eden et alalso teach that the backing store can be retentive, such as magnetictape recorders and disk recorders, while a front store can be a volatilestore, such as a magnetic core store. With advances in data storagetechnology, the front store now typically includes a semiconductive-typedata storage elements, for example as seen in U.S. Pat. No. 3,839,704.

A main purpose in providing the cache is to enhance the performance.Enhanced performance means reduced access time to any requested unit ofdata, as well as providing faster transfer of the data from the datastorage subsystem to a requesting host processor, or in the reverse,accepting data at a faster rate than would be provided if the hostprocessor were directly recording into a backing store. One of theproblems in providing such enhanced performance is that computerprograms or processes executed in the host processor have differentoperational characteristics. That is, some programs will access andrecord data in what can be termed a random access mode. In suchinstances, the amount of data sequentially transferred is minimal. A setof references or accesses to the data typically do not involve largeamounts of data but "randomly" access data storage locations. Othercomputer processes executed in a host processor sequentially accesslarge amounts of data which are processed quickly such that theinput/output rate of the host processor is extremely high. If the cacheand the residency of data in the cache are designed to enhance theoperation of the random access processes, then the performance of thehighly sequential processes are degraded. Of course it should also berealized that computer processes demand different I/O characteristicsintermediate the random and sequential processing. All of thesedifferences result in differing host processor performances using acached peripheral data storage subsystem.

Attempts have been made to improve the performance for both random andsequential processes by having the host processor indicate to the datastorage system whether the process results in a random I/O procedure ora sequential I/O procedure. One such arrangement is shown by Bastian etal in U.S. Pat. No. 4,466,059. Reference is made particularly to FIG. 3of Bastian et al. There, Bastian et al teach that the data processinginput/output operations are handled in so-called chains of command. Suchchains of command are generated by a so-called channel processor withinthe host processor. Upon the completion of one chain of peripheraloperations, corresponding to the execution of a single channel program,a control unit managing the cache and the backing store (in the case ofBastian et al they illustrate a magnetic disk recorder as the backingstore) the character of the data transmissions in the just previouslyexecuted chain of peripheral operations is examined. Included in thisexamination is whether or not the host processor supplied a sequentialbit, i.e., indicate that the I/O process is to be an input/outputsequential operation. Also, the types of data recording operations wereexamined, i.e. were there combinations of recording operations with thesequential bit. Then certain tracks of data (a track of data is theamount of data storable on one track of the magnetic disk recorder) aredeleted from the cache, i.e., transferred from the cache to the backingstore and erased from the cache. Also, it was examined whether or notany writing by a host processor occurred during the chain of operation,i.e., did the host processor only read data from the subsystem? Ifreading only occurred and a sequential bit is set, then the next trackof the disk recorder is transferred to cache. It should be rememberedthat in sequential data, the normal process for a host processor toprocess the data is to go from a low address to a higher address in anydata storage unit. Accordingly, a next track means a track having abacking store address one greater than the backing store address of thetrack currently being accessed in the cache. Of course, if such nexttrack is already resident in the cache, it would not be promoted fromthe backing store to the cache store. In the arrangement taught byBastian et al, the just-described operations are performed immediatelyupon the conclusion of the chain peripheral operation or immediatelybefore a chain of operation is to be next executed. The advantage of thelatter is that it could avoid unnecessarily promoting one track of datato the cache. The Bastian et al patent appears to be directed towardprimarily random type of computer processes, i.e., the teaching is thatwrite hits are to be discouraged and read hits are to be encouraged. Theaddition of the sequential bit is an accommodation and a recognitionthat sequential data processing is important, and it is important tohave reasonable performance for such sequential data processing.

While the Bastian et al technique provides for enhanced performance formany computer processes, there are still many computer processes thatcould be enhanced further by improving the sequential processing of datain the data storage subsystem such that the computer process would nothave to wait for completion of data transfers. It is also desired that asequential mode of operation be implicitly detected rather than alwaysrequire the host processor to command or declare a sequential mode ofoperation for each and every computer process that would benefit from asequential mode of operation.

An example of a data promotion scheme adapted primarily for a high rateof sequential processing is shown in Tayler, U.S. Pat. No. 4,414,644.Tayler requires that the host processor not only indicate that data isto be sequentially processed but also the extent of that data to besequentially processed. That is, an entire locality of references for agiven computer process is declared to the data storage subsystem. Inthis event, when the host accessed to the cache results in a cache misson a read operation, then all of the data to be found in an immediatelocality of references that was declared to the data storage subsystemare promoted to cache. While this procedure certainly enhances a highrate of sequential processing, it also uses an extremely large amount ofcache data storage space. Since a large number of computer processes maybe sharing the cache, such large usage for a single process may bedetrimental to the efficiency of a data processing installation.Therefore, the use of Tayler technique for sequential processing isuseful in certain situations, but is not necessarily efficient in otherdata processing situations.

It is also to be recognized that magnetic disk recorders have been usedfor years with host processors. Accordingly, many computer processeswhich were established long before caching was commonly used in aperipheral data storage subsystem optimized the computer process byaccommodating the physical parameters of magnetic disk recorders. Suchphysical parameters include latency time of the disk rotation and theseek time in changing from one set of tracks to another plus theknowledge of data storing cylinders, i.e., a set of tracks having acommon radius on a set of stacked record disks mounted on a commonspindle for rotation. Such cylinders resulted in almost zero trackswitch time in that electronic circuits were used to switch between thevarious transducers on the respective data storing surfaces of the diskwithin a single cylinder of tracks. Based upon this knowledge, certaincomputer processes transfer data from a complete cylinder of tracks as asingle multitrack I/O operation. In such a multitrack operation, theintervention of a cache store in the data transfer process normallyincreases the access time, thereby unintentionally reducing performanceof computer process. It is desired to avoid such degradation ofperformance for any program.

Accordingly, a plurality of modes of operation which are implicitlydetermined are desired for a cached peripheral data storage subsystem.

Tobias in U.S. Pat. No. 3,898,624 shows a processor cache interposedbetween host processor circuits and a so-called main memory. The cacheoccupancy is determined by an operator using a system console of thesystem The system console indicates to the cache control circuits of theprocessor cache the type of prefetching required for enhancing theperformance of a given computer process currently being executed. Tobiasprovides for eight different states based upon the operations to beperformed. The eight states have different prefetch characteristics forenhancing the respective computer processes. For example, instructionprefetch has different prefetch characteristics than an operandprefetch, which is different in turn from a "channel" prefetch. Suchoperations are commanded from the system console, i.e., are effectivelymanually selected. While such differing prefetches are tuned to the typeof operation do provide enhanced performance, it is desired toaccommodate other parameters which affect differing input/output datarates in sequential data processing. For example, a peripheral datastorage subsystem can be attached to a plurality of host processors.Each of the host processors can have a different computing capabilityresulting in differing data rates in their respective input/output (I/O)operations. For example, if the same program or process were executed ina highly capable host processor, a relatively high input/output ratewould be demanded to provide for efficient process execution. This I/Ooperation requires a greater amount of prefetch independent of the typeof program or operation being performed. In contrast, when such aprogram is executed on a lower capacity host processor, then theinput/output sequential rate could be reduced. It is desire, therefore,to implicitly determine the rate of sequential processing in a hostprocessor and adjust peripheral data storage operations in accordancewith such implicit determination of host processor execution rates.

SUMMARY OF THE INVENTION

It is an object of the present invention to provide for management of acache unit of a peripheral data storage subsystem by implicitlydetermining the apparent input/output rate for any computer process onany host processor accessing the data storage subsystem whether it befor recording data in the subsystem or for reading data from thesubsystem.

In one aspect of the invention, a group of tracks in a cache in aperipheral data storage subsystem are selected with the access extentsin the group of tracks being measured and the measurements stored forlater analysis. Access extents are the total number of data bytesstorage locations in a track accessed by a host processor during thecurrent cache track allocation. The access extents are analyzed in asmall group of allocated cache tracks. When a number of cache tracksless than desired for a group are not in the cache, then the analysis isdispensed with, i.e., no sequential mode will be implicitly determined.The access extents of the individual cache tracks in a group areanalyzed and combined into a single figure for generating a promotionfactor (PF) which is used for determining the number of backing storetracks of data to be promoted and kept promoted in the cache, and,optionally, number of cache data stored in a track which may be demotedfrom the cache. The analysis is directed to a last cache track accessedby a host processor. Allocated cache tracks having immediately smallerbacking store addresses but which are resident in the cache are combinedwith the last cache track accessed from a group. This group is aselected group of cache tracks. When the access extents of such selectedgroup exceed a threshold, then a number of tracks of data aretransferred from the backing store to the cache which have addressesimmediately above the backing store address last access track in cache.The PF factor determines the number of tracks of data to be promoted.The PF factor indicates a sequential I/O rate of the computer processusing the I/O operation. This algorithm is a so-called "rolling"algorithm in that the last cache track accessed always has the highestbacking store address in the selected group which have access extentsdetermining the number of tracks of data to be deleted from cache andthe number of tracks of data to be promoted to cache from the backingstore. The deletion of data from cache tracks can be controlled by aleast recently used algorithm rather than using the sequential analysisfor deleting or casting out data from the cache. Once a sequential modeis set for a given cache track, that mode is maintained until that trackis itself cast out.

In another aspect of the invention, a limit on the value of PF is setsuch that the implicit determination of sequentialness is limited toprefetching a predetermined maximum number of tracks of data. When theprefetching is limited, it not only is cache space conserved, but alsoenablement is provided for a computer process to bypass cache fortransferring extremely large amounts of data from a backing store and ahost processor, such as a complete cylinder of data in a multi-disk datarecorder.

The foregoing and other objects, features and advantages of theinvention will be apparent from the following more particulardescription of preferred embodiments of the invention, as illustrated inthe accompanying drawings.

DESCRIPTION OF THE DRAWINGS

FIG. 1 is a simplified block diagram of a peripheral data storagesubsystem which employs the teachings of the present invention.

FIG. 2 gramatically illustrates a locality of references for a datastorage subsystem shown in FIG. 1.

FIG. 3 is simplified diagram showing some control tables of the FIG. 1illustrated data storage subsystem usable with the present invention.

FIG. 4 is a machine operations chart showing implementation of theinvention in the FIG. 1 illustrated data storage subsystem.

DETAILED DESCRIPTION

Referring now more particularly to the appended drawings, like numeralsindicate like features in the various figures. Referring moreparticularly to FIG. 1, the environment in which the invention ispracticed is described. One or more host processors are connected to theillustrated data storage subsystem via an attachment or channel 10. Thedata storage subsystem includes one or more data storage devices 11,preferably disk recorders also referred to as direct access storagedevices (DASD). A programmed control 12 in the peripheral data storagesubsystem controls the subsystem operations and the transfer of databetween DASD 11 and host processors through attachment 10. Line 13indicates this control function, which is well known. Programmed control12 has its own microprocessor (not shown), such as seen in U.S. Pat. No.4,466,059. Particularly refer to FIG. 2 of the cited patent which showsthe hardware arrangement which may be advantageously employed with thepresent invention. Programmed control 12 has its own control programstorage which includes a set of control programs (pgms) 14. Themicroprocessor in programmed control 12 reads the control programs andresponds thereto for effecting control and management of the datastorage subsystem as represented by line 13. The operation andmanagement also requires a set of control tables 15 which store controlcommands and other parameters received from the host processors, statusinformation about the data storage subsystem, as well as otherparameters useful for operating a data storage subsystem, all as isknown.

To enhance the performance of the data storage subsystem, a cache 17 islogically and electrically interposed between DASD 11 and the attachment10. Operation of a cache 17 is also described in the documentsincorporated by reference. Programmed control 12 has additional controlprograms named sequential programs (seq pgms) 24 for managing the cacheas well as controlling the DASD 11 in accordance with the presentinvention. Data transfers are also more complex. Programmed control 12exercises control of the transfer of data between DASD 11 and cache 17as symbolized by line 18. The transfer of data between host processor 10and cache 17 is also controlled as symbolized by line 19. The controlfor transfer of data directly between host processors and DASD 11continues as symbolized by line 13. Various data promotion and demotionalgorithms relate to the transfer of data symbolized by line 18.Promotion is transfer of data from DASD 11 to cache 17 whereat it can bereadily accessed by a host processor via attachment 10. Demotion ofdata, or cast out of data, is a transfer of data from cache 17 to DASD11. The transfer of data from cache 17 to DASD 11 is usually accompaniedby deallocating the data storage space in cache 17 for making room forother data which host processors may wish to read data from or recorddata into.

The access to cache 17 is under control of a directory 22 and a scatterindex table (SIT) 23. Such access is described by Benhase et al in U.S.Pat. No. 4,464,713. According to that patent, the cache 17 which storesdata intended for or residing in DASD 11 is accessible by using theaddresses for such data of DASD 11. Directory 22 is a table which allowstranslation of the DASD 11 addresses to the physical cache 17 addresses.Because of the relatively large size of a cache 17 (50 megabytes or morefor example), a hashing technique as shown by Benhase et al is employed.This hashing includes a scatter index table 23 for accessing directory22 in a minimal time. Another factor with using the Benhase et alinvention in the peripheral data storage subsystem is that the SIT 23entries within a cylinder are contiguous as are the tracks in DASD 11.That is, if a current track stored in cache 17 is being accessed, thenthe two tracks immediately adjacent to the current track, as physicallylocated in DASD 11, are identified in adjacent registers of SIT 23. Infact SIT 23, as explained later, has a doubly linked list for readilyaccessing the directory 22 entries.

The additional programming included in programmed control 12 forimplementing the present invention is diagramatically illustrated as theSEQ PGMS 24 (sequential programs). Such SEQPGMS 24 are actually embeddedinto the control programs 14 and may be located in several diverse andseparated locations within programs 14. For purposes of understandingthe present invention, sequential programs 24 are broken out separatelyand illustrated as machine operations in FIG. 4. Machine operations arethe results of programmed control 12 reading the sequential programs andexercising control over the data storage subsystem in response toreading such sequential programs

The success of the present invention is based in part upon anobservation of the peripheral data storage subsystem called locality ofreferences. Such locality of references results from the fact that agiven process being executed in a host processor, connected to aperipheral data storage subsystem tends to record into and read fromaddressable data storage areas having contiguous addresses. This isobservation particularly true for those processes which sequentiallyprocess data, as explained in the prior art. FIG. 2 diagramaticallyillustrates a principle of locality of references. The tracks in cacheare those tracks 30-32 which are in solid lines while the tracks next tobe accessed 35-36 are indicated by dash lines. The tracks are shown asbeing adjacent because of the contiguous addresses in DASD 11; in cache17 such tracks may be in diverse locations indicated by directory 22,but for purposes of discussion, they are logically adjacent andphysically adjacent in DASD 11. A currently accessed track 30, alsoreferred to as "N", is the last cache track accessed which is to beanalyzed for sequential properties. To do this analysis, the previouslyaccessed tracks 31-32, which respectively have addresses in DASD 11 oneless and two less than the physical address of current track 30, arecombined with track 30 into a selected group of cache tracks foranalysis of host processor access extents Track 31 is termed N-1 forindicating the relative address in DASD 11 of that track with respect tothe current track 30 while track 32 is termed N-2. The hashed portions33 indicate those records of data bytes in tracks 30-32 which have beenaccessed by the host processor. It can be seen that track 32 is 100%accessed, track 31 is 60% accessed, while track 30 is 80% accessed Thedifferent groups of hashing 33 indicate respective records using thecount key data (CKD) format as found in DASD 11 used by InternationalBusiness Machines Corporation CKD architecture allows for variablelength records. For a given process being executed in the hostprocessor, the records involved generally are of the same length butvary between processes or portions of processes in accordance withprogramming designs. Another type of architecture is so-called fixedblock architecture which breaks the data storage areas into fixedlengths, such as for storing 512 bytes, 2000 bytes and so forth. Suchfixed block architecture, while easier initially to implement, doesrequire a greater amount of data storage area per user byte to bestored. Accordingly, for high performance data processing, the CKDarchitecture is preferred. However, for practicing the present inventioneither architecture or format can be used, as well as other dataformats.

After programmed control 12 has examined the access extents of tracks30-32, it calculates, according to the sequential programs 24, apromotion factor PF for the current track 30. Such promotion factordetermines the number of tracks, having addresses contiguously higherthan the current track, to be promoted into cache 17 from backing store11. It may also be used for indicating the number of tracks to bedeleted that had previously been read or written to, such as tracks31-32. As seen in FIG. 2, track 35 of DASD 11 has address N+1 and wouldbe the first track of data to be promoted to cache 17. Similarly, secondtrack 36 having an address N+2 would be a second track of data to bepromoted to cache 17. Of course, if the data in DASD tracks 35, 36 arealready stored in cache 17, the promotion is dispensed with. Inaccordance with the invention, if the access extents 33 of the tracks inthe selected group 30-32 indicate a relatively high rate of sequentialprocessing, then the contents of both DASD tracks 35-36 are promoted tocache 17. For a smaller access extents indicating a slower rate of hostprocessor input/output sequential data transfers, then the data contentsof track 35 are only promoted to cache 17. In this manner, the presentinvention allows tailoring the prefetching to the actual execution rateof the host processor process for optimizing not only the performance ofthe process within the host processor, but also data occupancy of cache17.

In accordance with one embodiment of the invention, the host processoraccess extent of a given cache track during its current allocation to aDASD track is used as a trigger mechanism for determining whether or nota sequential mode should be considered and established for the currenttrack 30. An individual access extent threshold J represented by dashline 37 is first examined for the current track 30. As shown in FIG. 2,the access extent threshold or trigger is 40%. This figure isarbitrarily chosen for purposes of illustration only. The triggerindicates that for the cache 17 involved, i.e., the size of the cache,the empirically determined characteristics of the processes beingsupported by the data storage subsystem and other host processorparameters to be empirically determined, that access extents less thanthe trigger level 37 indicate a sequential data processing rate isinsufficient rate to justify prefetching data to cache. On the otherhand, with access extents greater than the trigger 37 indicate than anaccess extent analysis is required. It is not desired to make a decisionon a single cache track access extent, but on a group of selected tracksto obtain a more meaningful decision. When all of the tracks 30-32 inthe selected group have an access extent greater than J, then thecombined access extent for all of the tracks is calculated, otherwise,the implicit sequential mode is not entered into, as will becomeapparent.

Programmed control 12 has a large number of control tables 15 inaddition to directory 22 and SIT 23 to operate the data storagesubsystem. Those portions of the directory, SIT and control tablespertinent to an understanding of the present invention are shown in FIG.3, it being understood that in a practical embodiment the actual numberof control tables will be much greater than that shown in FIG. 3. Asingle entry 40 of directory 22 is shown, it being understood there is asingle entry for each of the addressable data storage areas or tracks incache 17. This fact is indicated in FIG. 3 by the unnumbered ellipsis.Directory entry 40 which can be considered as being for the currenttrack 30 includes device address field 41. Device address field 41includes the address of DASD 11 together with the head address withinthe cylinder and the cylinder address also referred to as DCCHH whereinD is the actual address of the DASD storage unit, C is the two bytecylinder address and H is the two byte head or surface address. Cacheaddress field 42 is optional and is used only when the offset address ofdirectory entry 40 from a base directory address does not implicitly orimpliedly point to the physical address of the cache storage arearepresented by entry 40. B byte 43 indicates that the data stored in thecache area indicated by field 42 is bound or fixed into cache and cannotbe discarded, demoted or cast out from the cache. When the B byte isunity, then the later-described data demotion operation will not beperformed on those areas of cache. CS byte 44 indicates that the mode ofoperation for the data area indicated by field 42 is a commandedsequential. This means that the host processor has sent an indication tothe programmed control 12 indicating that the mode of operation iscommanded sequential. Such a commanded sequential operation is shown inTayler, U.S. Pat. No. 4,414,644. IS field 45 indicates that the mode ofoperation for the data area represented by entry 40 is impliedsequential and is set in accordance with the present invention asillustrated in FIG. 4. In some embodiments of the present invention, acommanded sequential operation as set forth in Tayler supra is dispensedwith. In this instance a single bit in entry 40 indicates a singlesequential mode. The mode of operation for a commanded sequential andthe implied sequential mode is then identical. PF field 46 contains thepromotion factor PF to be used in connection with the implied sequentialmode of operation. In the event of a single bit indicated sequentialmode, a PF value of unity or 2 can be always made for the commandedsequential mode or the PF factor can be provided by the host processorwith the sequential bit. Ellipsis 47 indicates that each directory entry40 includes additional fields not shown in FIG. 3. As an example, theentries can be singly or doubly linked together based upon deviceaddress 41 or other parameters as may be desired. By linking with deviceaddress 41, the next higher and next lower DASD 11 address will be thelogical neighbors of entry 40 in the linked list such that the logicalconnection is a faster connection for finding the contiguouslyaddressable DASD 11 data areas that are assigned to cache 17.

A portion of SIT 23 is shown as a single entry 50 with additionalentries of sit 23 being indicated by ellipsis 51. A hash address 52 isself-identifying data for the SIT address. Link field 53 provides foreither single or double linking, as is well known. The directory addressfield 54 indicates the offset address of entry 40 for example, from abase address for the entire directory 22. Device address 55 indicatesthe device address and corresponds to field 41 of entry 40. In someinstances, device address 55 may be dispensed with.

Control tables 15 store a lot of control parameters as can be determinedfrom the cited prior art and other known patents showing cachedperipheral data storage subsystems. Illustrated are two sets ofregisters of interest to practicing the present invention. It is to beunderstood that instead of storing the data in these separate registers,the data described may be stored with a directory entry 40 or with a SITentry 50, as may be desired. A first register set includes theillustrated register 60 and additional registers represented by ellipsis61. Register set 60, 61 stores the access extent values for theindividual cache storage areas of cache 17. Record size field 62indicates the measured size of record used in the CKD architecture. Fora fixed block architecture size, a single entry in programmed control 12indicates the size of the fixed block used. No records field 63indicates the number of records accessed for a given addressable datastorage area of cache 17. Defined extent field 64 indicates the boundaryaddresses of a defined extent as set forth in U.S. Pat. No. 4,262,332,which defines the limit of operations for a process currently accessingthe data storage areas in the subsystem. The defined extent is expressedin backing store addresses. There is one register 60 for each of thecache data storage areas. Accordingly, the register 60 is a candidatefor including with the directory entry 40.

A second register set, including a register 70, stores data related toparameters used in calculating the promotion factor stored in field 46.Ellipsis 71 indicates that additional registers may be employed forstoring these parameters. The first parameter is stored in field 72called M. Parameter M, which can be empirically determined, is used forexpanding the analyzed access extents for increasing the number oftracks to be promoted to cache for given measured access extents. Theselection of the number for M is based in part upon the data storagecapacity of cache 17; a larger cache 17 makes M larger. If a large cache17 is employed, then additionally stored promoted data may provide foradditional cache hits for increasing overall performance. It is believedthat the smallest number that M should be selected is 2 for providing areasonable improvement in sequential data processing. A second field J73 stores the threshold value corresponding to the threshold indicatedin FIG. 2 by dash line 37. The proportional value of J in FIG. 2 isindicated as being 40%. Other selections can be higher, for example,50%, 60% or 70% depending upon the empirical experience withimplementing the present invention. It is believed that values lowerthan 40% may prematurely institute an implied sequential mode ofoperation. However, it is conceivable that systems could employ lowerthresholds than the illustrated 40%.

Field K 74 indicates the number of data storage areas in cache 17 thatare to be examined as a selected group. The number of such additionalareas or tracks of cache 17 is at a preferred minimum of unity and amaximum of 3 or 4. Accordingly, in accordance with the preferred mode ofoperation, a selected group would have a minimum of 2 tracks of cache 17stored data and a maximum of 5, no limitation thereto intended Host IDfield 75 can identify a process in a host processor with which theparameters M, J and K will be employed. In an early embodiment, a singleset of parameters M, J and K were used for all host processors. As theoperational capability of host processors being more divergent, it maybe desired to have different values for the different host processorssince the host processors identify themselves in each request eitherimplicitly or explicitly. The programmed control then can select an M, Jand K value for the respective host processor to accommodate a widerange of computing capabilities. If greater refinement is produced, thehost ID 75 may include classes of processes as indicated to theprogrammed control 12 based upon either a subchannel assignment(implicit) or within a commanded set up (explicit). This descriptionassumes that M, J and K have the same values for all host processors.

FIG. 4 illustrates the machine operations represented by the sequentialprograms 24 of FIG. 1. It was stated that the sequential programs areinterleaved into the control programs 14. It is preferred that a portionof the sequential programs be incorporated with command execution fordata transfers between host processor and the data storage subsystem ofFIG. 1. An example of such interleaving is shown in the Tayler U.S. Pat.No. 4,414,644 in its FIG. 5. Therein is shown a command decode at 17which proceeds through a series of machine operations for transferringdata to a host at step 103. Upon completion of that data transfer to thehost, other machine operations follow. It is at this point that thesequential programs 24 could be executed. It is preferred that theinterleaving of the sequential programs 24 is upon completion of a dataaccess to cache as shown in FIG. 4. Yet other portions of sequentialprograms may be executed at yet other times based upon well-knownsystems of dispatching computer control operations, known in the priorart, and not described for that reason.

A set of current track operations 98 is first described. Entry into thecurrent track operations is from decoding a command received from a hostprocessor, as represented at entry point 99. In this instance, asindicated at step 100, the host is addressing the data storage subsystemfor accessing an addressed data storage area for either a read or awrite operation. At step 101, programmed control 12 determines byexamining directory 22 whether or not a data storage track has beenallocated in cache 17 for the backing store address sent by the hostprocessor along with the received command. If there is an allocated areain cache 17, a so-called cache hit occurs, otherwise a cache missoccurs. First it is assumed that a cache hit occurs, i.e., cache 17 hasa data storage track allocated in cache 17 for the DASD 11 addressreceived with the command. At step 102, programmed control 12 allowscache access by the host processor to the addressed DASD 11 trackcontents stored in cache 17. Such operations are as described by Benhaseet al in U.S. Pat. No. 4,464,713. Upon completion of that access, whichalso corresponds to the data transfer step 103 of Tayler patent, someprogrammed control 17 data processing functions are performed at step103 which includes updating the access extent history within controltables 15. For example, during the cache access step 102, programmedcontrol 12 monitors the size of the record being transferred as well asthe number of records. Usually there is one record transferred perchannel command, as an example, no limitation thereto intended.Therefore, as a part of post-data transfer operation, programmed control12 updates a register 60 which corresponds to the register 40 ofdirectory 22 used to access the track of cache 17. Upon completing theupdates, which may include other data updates, programmed control 12then detects the mode of operation assigned to the accessed track tocache 17 track in a series of mode examination steps 104. Firstly, atstep 105, CS byte 44 is examined to determine whether or not the datatransfer is a part of a commanded sequential mode of operation. If CS 44equals unity, then at line 106 programmed control does the posttransfercommanded sequential operations as set forth in the Tayler patent supra.If CS 44 is 0, then at step 110 programmed control 12 examines IS byte45. That is, it may have been that the implied sequential mode was setup before completion of the cache access at step 102. If IS is equal tounity, then the implicit sequential mode has already been establishedfor the accessed cache track (note that the mode control is on a cachetrack basis). Then programmed control 12 follows operations path 111 toperform sequential cache management operations 112, as later described.If on the other hand IS bit 45 is 0, then using later describedsequential access detecting step 113, programmed control 12 determineswhether or not sequential data access is in fact occurring for theaddressed cache 17 track.

Mode detector 104 may only include step 110 in those instances wherein aseparately operated commanded sequential mode is not employed. Forexample, a commanded mode may also set IS bit 45 and the programmedcontrol 12 responds to the "commanded" IS bit being set to set PF field46 to unity or to 2 depending upon the desired number of tracks to beprefetched into cache 17.

Sequential access detecting steps 113 comprises a first step 115 whereinthe current track, i.e., the last track accessed track 30, is examinedas to its present host access extent. The value B indicates the numberof bytes accessed by a host processor since the current track storeddata were promoted to and have been resident in cache 17. The value B isthe product of the numbers contained in fields 62 and 63 of the controlregister 60 assigned to current track 30. Alternatively, the value B canbe based upon an actual byte count developed using known techniques fordata transferred in or out of the cache 17. Each byte is counted onlyonce regardless of the number of times the byte area in cache isaccessed. However, with CKD architecture the number of records accessedat least once is easier to count. In any event, the value B is comparedwith the threshold J (represented by dash line 37). For a DASD 11 havinga track count of 14,000 bytes, then the value J at a 40% threshold is5,600 bytes that were accessed to exceed the threshold. If the accessextent does not exceed the access trigger or threshold J, thenprogrammed controller 12 sets IS byte 45 to 0 (even if the initial valueis 0) and returns to other programs 14 as indicated by line 117. Thepractical effect of this return is to keep the management of cacheinsofar as current track 30 is concerned in the random access mode.

The measured access extents can represent either of two types ofmeasurements on the cache tracks. In a first preferred measurement modethe total number of bytes transferred at least once between a hostprocessor and cache 17 are counted. This means that if a firstone-fourth of a cache track were read by host processor followed by awrite to the first one-fourth of a cache track, the measured accessextent of that cache track is one-fourth or 25%. In a second measurementmode, the measured access extent represents the total number of bytestransferred even though the same bytes are repeatedly transferred arecounted. Taking the example of a one-fourth track access, using thesecond measurement mode results in a measured access extent of one-halfor 50%.

On the other hand, if at step 115 the measured access extent of currenttrack 30 exceeds threshold J, then programmed processor 12 analyzes theimmediately lower addressed tracks that are currently stored in cache17. In the event that no adjacently addressed tracks are stored intocache 17, i.e., there are no allocated tracks 31 and 32, then from step120 programmed control 12 proceeds through step 116 to return path 117.If in the examination of the directory 22 or SIT 23 tracks 31 and 32 arein fact resident in cache 17, then programmed control 12 compares themeasured access extents for the tracks 31 and 32 up to the value of Ktrack for determining whether or not the access extents of the selectedgroup of tracks should be combined. Assume that K equals 2, then theaccess extents of the tracks 31, 32 are individually checked against thethreshold J. As shown in FIG. 2, their access extents both exceed thethreshold J which indicates that an implicit sequential mode ispossible. On the other hand, if either of the access extents in tracks31 or 32 were below the threshold J, then programmed control 12 proceedsto step 116 thence return path 117 for keeping the current track in therandom access mode.

Assuming that the measured access extents of tracks 30-32 all on anindividual basis exceed threshold J, then at step 121 program processor12 sets IS byte 45 to unity for indicating the implicit sequential modefor the current track 30. Then at step 122, programmed processor 12calculates the promotion factor PF for field 46 corresponding to currenttrack 30. In the current embodiment, equation 1 set forth below issolved. ##EQU1## wherein PF is the promotion factor in tracks, M is thelook ahead factor stored in field 72 of control register 70, B is theaccess extent in bytes for the tracks 30-32 which constitute theselected group of tracks in calculating the prefetched quantity for theimplicit sequential mode. The denominator T is the current track datastoring capacity. The quotient is rounded to the closest integer. Forexample, if MB/T=2.5, then 3 tracks are prefetched. However, if thequotient is 2.2, then the number of tracks is rounded to 2. The PF valueset forth in tracks is then stored in field 46. Other equations andalgorithmic procedures may be used in calculating the performancefactor. In any event, the promotion factor has a figure of merit greaterthan the access extents for all of the tracks in the selected group oftracks 30-32. In some situations, the value of K is preferred to beunity. In such a selection, the selected group tracks then constitutecurrent track 30 and N-1 track 31. In other situations, the value of Kmay be 0 such that only the access extent of current track 30 isemployed. It is preferred that more than one track be used in theanalysis.

After storing the PF value in field 46, programmed processor 12 proceedsto step 125 for comparing the PF factor with respect to a PF limit "L".This comparison step creates a window of operation for declaring animplicit sequential mode of operation, i.e., the J factor indicates alower level while the L limit indicates an upper level. As an example,the limit L may be equal to 3, i.e., no more than 3 tracks of datashould be prefetched from DASD 11 to cache 17 that have 3 increasingcontiguous DASD addresses greater than the DASD 11 address for currenttrack 30. If the PF value in tracks is greater than the limit L (whichis stored in a control register not shown in FIG. 2), then programmedcontrol 12 proceeds over path 126 through step 116 to return path 117.The practical effect of this arrangement is to prepare the cache forimplicit cache bypass. Implicit cache bypass can be determined in one ofseveral ways, one of which is shown in U.S. Pat. No. 4,500,954 for animplicit cache bypass whenever a write miss occurs.

In this regard it should be noted that the general mode of operation isthat a host processor first reads data from DASD 11 through cache 17.During this set of reads it may be determined that the mode of operationof the process within the host processor is a sequential mode ofoperation meeting the implicit sequential mode requirements. Once the ISbyte 45 is set to unity, that mode selection carries forward to theensuing recording or writing steps when host processor stores updateddata in cache 17. During such writing sequences, when the IS byte 45 is0 and there is a write miss in cache 17, then for the remainder of thecylinder writes (see U.S. Pat. No. 4,500,954) cache 17 is bypassed formaking an efficient extra long transfer of sequential data from the hostprocessor to DASD 11 by bypassing cache 17.

On the other hand, when the calculated PF for the current track 30 isless than or equal to the limit L, programmed control 12 proceeds to thesequential cache management operations 112, i.e., IS byte 45 is still 1as detected at step 110. Sequential cache management operations 112 canconsist of two different modes of operation. The first mode A asrepresented by terminal A of program represented switch 129 causes thecache tracks having addresses less than but contiguous with the currentcache track 30 to be reclaimed for use in other data processingoperations. That is, the data contents of tracks 31 and 32, for example,would be demoted from cache 17 to DASD 11 and deallocated from cache,i.e., made free for other allocations. This action is indicated in step130 representation as reclaiming tracks N-1 through N-PF where PF is thecalculated promotion factor for the current track. Step 130 can bemodified such that track N-1 stays in the cache 17 making the reclaimedtracks tracks N-2 through N-PF. Upon completion of the reclaiming orcasting out of the data of lower addressed N-1 to N-PF tracks,programmed control 12 at step 131 erases the tables associated with thereclaimed tracks, such as a directory 22 entry, the SIT 23 entry andregisters 60 and 70 of control tables 15 that appertain to thosereclaimed tracks. Following the reclaiming of tracks, the data stored inthe tracks 35-36 of DASD 11 are then promoted in step 132 into cache 17.This assumes, of course, the calculated PF is 2 such that 2 tracksshould be promoted. Of course, before the promotion, programmed control12 examines directory 22 to determine whether or not either or both ofthe tracks 35, 36 are already allocated in cache 17. If so, the datapromotion is dispensed with. Following the promotion of data, theimplicit sequential operation for the current track being accessed andfor the current cache head is complete. Accordingly, at exit point 133programmed control 12 returns to control programs 14.

On the other hand, when the program representative switch 129 is set toterminal B, then the reclaiming steps 130, 131 are dispensed with andonly the data promotion step 132 is performed. In this situation, thereclaiming of tracks in cache 17 are based upon aging algorithms oftenreferred to as least recently used (LRU) algorithms as will be explainedlater with respect to the continued description of FIG. 4. Programswitch 129 can be set to either terminals A or B for all of the hostprocessors as indicated with the present description; however, switch129 can be actuated to either terminals A and B in accordance with thehost ID 75 as shown in FIG. 3.

Returning now to step 101, the description assumes that rather than acache hit a cache miss occurs. That is, the DASD address supplied by thehost processor in requesting a data transfer operation identifies noallocated track space in cache 17. This cache miss is true for either aread operation or a write operation. For a write operation, according tothe cache bypass principle set forth in U.S. Pat. No. 4,500,954, a cachebypass may occur. In that case, the implicit sequential mode is notaddressed since access to the data area of DASD 11 does not involvecache 17. On the other hand, if the commanded transfer operation is aread, then cache 17 continues to be involved with a possible implicationfor the implicit sequential mode. Also, in a write operation, the bypassmay not be implemented for a write miss. In that case, the implicitsequential mode analysis will also be conducted.

In any event, assuming that a cache bypass is not instituted because ofthe cache miss, at step 107, programmed control 12 promotes data fromDASD 11 directly to the host processor with a copy of such going to anallocated track of cache 17. In that case, track 30 receives the data tobecome the current track. In a case of a write miss, it may be decidedthrough architectural decisions that instead of going directly to DASD11, space will be allocated within cache 17 for receiving the writtendata with the written data being later transferred or demoted to DASD 11from cache 17. In this case, step 107 consists of receiving data intothe allocated space of cache 17 directly from host processor overattachment 10. Upon completion of the allocation of a new track intocache 17 through the execution of step 107, sequential mode detector 104is executed by programmed control 12. This execution may occur (asmeasured in electronic terms) a substantial time after the promotion ofdata into cache 17 from either the host processor or from DASD 11. Suchpromotion does not result in any entry being made in register 60 as tofield 63, i.e., is not a host access to cached data. However, the recordsize 62 can be measured when CKD architecture is employed. Because ofthe delay after executing step 107, host processor may actually after aread promotion start writing data back to the same DASD 11 addressresulting in the host processor accessing the just promoted data area ofcache 17. Accordingly, mode detector 104 is executed followed by theother operation steps set forth in implicit sequential detector 113 andsequential cache management operation 112, as previously described.

Based upon the above description, it is seen that the implicitsequential mode is examined during or in parallel to execution of achannel program resulting in one or more data transfers between a hostprocessor and the peripheral data storage subsystem. Such parallelism inoperation from either a cache miss or a cache hit results in timelysequential operation detection. Such parallel operation is not necessaryto obtain advantages from practicing the present invention. Rather, theimplicit sequential analysis can be analyzed intermediate termination ofone channel program (appearing to the peripheral data system asdetermination of a chained set of peripheral operations) and the onsetof a next ensuing chain of peripheral operations. This latter type ofanalysis timing is shown in FIG. 3 of U.S. Pat. No. 4,466,059. It isimportant to note that the look ahead factor M should still be used suchthat the data promotion occurring because of the calculated PF valuewill not look only to the next ensuing chain of peripheral operations,but to chains of peripheral operations subsequent to the next occurringchain of operations. This is look ahead on efficient utilization of thepresent invention.

It was earlier mentioned that the sequential cache management operationsmay not include the automatic reclaiming of the tracks having addressesless than the contiguous width of the current track 30. A LRU or agingalgorithm can be used for cache cast out operations. This is shown inthe set of machine operations 139. Such LRU operations or cast outs canbe performed intermediate data transfer operations when programmedcontrol 12 and other circuits are not busy satisfying the host processordemands for data transfers. In such a system, a dispatcher, a commontool in program control (not shown), of programmed control 12 causes aexamination of the cache 17 aging as in an LRU table of known design.This is achieved at entry point 140. Then programmed control 12 executesa set of machine operations LRU 141. LRU 141 represents known operationswhich include analyzing the aging of the data stored in cache 17. Suchaging can be measured elapsed times from the last host access to anallocated track area of cache 17. As a result of such LRU operations, alist of tracks to be reclaimed is generated, such as shown in the Taylerpatent, supra. Following the generation of that list, the tracks are infact reclaimed by programmed control 12 at step 147. Following theactual reclaiming of the tracks, which includes demotion of data fromcache 17 to DASD 11 when the copy in DASD 11 is different from the copyin cache 17, programmed control 12 at step 149 erases the correspondingcontrol tables as explained with respect to step 131. Then controlprograms 14 are returned to at exit point 150. Additionally, a hostprocessor may indicate to a peripheral data storage subsystem thatcertain allocated tracks of cache 17 may be discarded through a discardcommand such as shown in Tayler, supra. Upon decoding the received hostprocessor supplied command, programmed control 12 at entry point 143provides a discard set up at step 144. Such set up is a listing of allof the DASD 11 addresses which might have allocated track space in cache17 which should be discarded from cache 17. Discard step 144 furtherincludes scanning directory 22 to identify all of the allocated tracksremaining in cache 17. Upon establishing the tracks to be discarded outof cache 17, the reclaimed track step 147 is performed followed by step149 and exit at 150. While the invention has been particularly shown anddescribed with reference to preferred embodiments thereof, it will beunderstood by those skilled in the art that various changes in form anddetails may be made therein without departing from the spirit and scopeof the invention.

What is claimed is:
 1. Data processing apparatus including a cache storeoperatively connected between a host processor and a backing store, thebacking store having addressable data storage tracks, both storesstoring data addressable by the addresses of the backing store datastorage tracks, each track being capable of storing an amount of dataequal to a given number of data bits, the host processor accessing, orprimarily accessing, the cache store for writing and reading data to andfrom both stores, and a cache controller determining the promotion anddemotion of data between the cache and the backing store and arranged,in operation, to switch between promotion and demotion protocols independence on the result of a running analysis of the proportion of datain the currently accessed track and its connected previously accessedtracks actually referenced in relation to predetermined thresholds, thecontroller, for each access to the cache store by the host processor,measuring the amount of data in that track that is referenced by theaccess as an indication of locality of reference and separately storingthe measured amount as an access extent for that track or incorporatingsuch there into and means for comparing the predetermined thresholdswith the stored access extents for yielding a given result, and thecontroller having means responsive to the given result to control saidpromotion and demotion of data.
 2. Apparatus as claimed in claim 1,wherein the host processor is arranged to send chains of accesscommands, each of which include a track address, to the cache controllerfor accesses invoked by any one such chain of commands, the controllercompares the access extent for the addressed track with a firstthreshold value and, if it exceeds such first threshold value, reads allof the other access extents for tracks in the cache with backing storeaddresses numerically adjacent the addressed track address and whichidentify tracks accessed or, under hashing, that reasonably bound havebeen accessed by the host processor in the chain before accessing thegiven track, separately compares all such with the first threshold valueand if a predetermined number of such also exceeds the first thresholdvalue, sets a sequential indicator for the current track, the controllerobserving a "by track" protocol if the sequential indicator is not setand a prefetching protocol if the sequential indicator is set. 3.Apparatus as claimed 2, wherein the controller, on setting thesequential indicator for the current track, combines the access extentsinvolved to produce a combined access extent value and compares it witha preset combined threshold value, the controller, if the combinedaccess extent value is not greater than the combined threshold value,generating an integral number proportional to the combined access extentto be representative of a sensed rate of I/O and promotes that number ofprefetched tracks and sets the sequential indicator for each of them. 4.Apparatus as claimed in claim 3, wherein there is a cache bypass and thecontroller is arranged, if the combined access extent is greater thanthe combined access threshold, to reset the sequential indicator for thecurrent track and causing all subsequent accesses in the chain to bypassthe cache for directly accessing the backing store.
 5. Apparatus asclaimed in claim 4, wherein track promotion and demotion takes placeeffectively concurrently with data transfers between a host processorand the cache and, if the controller is observing the prefetch protocoland a host processor supplied access command is invoked relating to atrack in the prefetch group being promoted which is not already in thecache, the actual data involved is sent via the bypass directly to thehost processor, the amount of the data transferred being recorded, andis also promoted with the rest of the track or tracks, in due order,prior to re-analysis of the access statistics for promotion and demotionprotocol determination.
 6. Apparatus as claimed in claim 5, wherein thecombined access extent is generated by suming an integral number ofpredetermined ones of the read access extents and multiplying the sum bya look-ahead constant value which is a number not greater than ten. 7.Apparatus as claimed in claim 6, wherein the predetermined accessextents are all access extents such that were any one of such to be lessthan the first threshold value, the sequential indicator would beprevented from being set.
 8. Apparatus as claimed in claim 5, whereincache space for prefetched tracks is generated by demoting the datacontents of tracks from the cache having backing store addressescontiguous but increasingly less than the backing store address of thegiven track and demoting the integral number of further tracks minus onefrom the cache store to the backing store beginning with a track havingtwo backing store addresses less than the given track backing storeaddress and proceeding to a track having an address equal to the addressof the given track minus the integral number of tracks to be prefetched.9. Apparatus as claimed in claim 8, wherein the host processor isadapted to send and the controller is adapted to receive and respond toa host processor supplied command defining an extent of host processorcurrent permitted access to contiguous backing store tracks beginningwith a first backing store address and ending with a second backingstore address the promotion of prefetched tracks and demotion of loweraddressed tracks being restricted to lie within the permitted accessextent.
 10. In a data storage system having attachment means forattaching the data storing system to a host processor whereby data maybe transferred between the host processor and the data storing systemfor storage and retrieval;data transfer means intercoupling theattachment means, the cache store and the backing store so that data maybe transferred directly between either of the stores and the attachmentmeans or between the two stores; a programmed control connected to theattachment means, the data transfer means and the two stores for sendingcontrol signals thereto and receiving command and status signalstherefrom such that the programmed control controls the operations ofthe data storing system; the programmed control including a controlstore for storing computer program indicia for sensing same andresponding to the sensed indicia to send out the control signals and tosense the analyze the received command and status signals; the storeseach having addressable data storing tracks of equal data storagecapacity; means in the programmed control stored computer programindicia to cause the programmed control to allocate predetermined onesof the cache tracks to store data addressably stored for predeterminedrespective ones of the backing store tracks; means in the cache storefor addressing the allocated cache tracks using the addresses of thepredetermined respective ones of the tracks in the backing store:monitoring program indicia in the control store for being sensed by theprogrammed control for executing computer programming contained in suchindicia for causing the programmed control for operating the system tomonitor the data transfers between the attachment means and the cachestore addressed ones of the allocated cache tracks for measuring thelength of data in each such transfer and storing the measured datalengths, then summing the measured data lengths for all data transfersbetween the attachment means and the respective cache tracks to create astored access extent for each of the cache tracks allocated to storedata; threshold indicia in the control store for indicating a thresholdvalue and being sensible by the programmed control for obtaining thethreshold value; indicator means in the data transfer means forindicating a completion of a last data transfer between the cache storeand the attachment means and the backing store address for the cachetrack used in the data transfer; comparison program indicia in thecontrol store for being sensed by the programmed control for executingcomputer programming contained is such indicia causing the programmedcontrol to operate the system for sensing the completion indicator andresponding thereto sensing the stored access extents for the cache trackused in the last data transfer and for "K" cache tracks respectivelyaddressable by backing store addresses contiguous with the backing storeaddress for the last access cache track, then the programmed controlprocessing the sensed stored access extents using predeterminedcalculations to create an intermediate value is greater than thethreshold value, indicating the sequential mode of operation for datatransfers in the last accessed cache track, wherein "K" is an integer;and data promotion program indicia in the control store for being sensedby the programmed control for executing computer programming containedin such indicia for causing the programmed control to operate the systemfor sensing the sequential indicator, if the sequential indicator isset, then causing the programmed control to operate the system forpromoting data from next backing store tracks to cache store tracks withthe tracks having backing store address contiguous with and greater thanthe backing store address of the last accessed cache track, calculatingthe number of tracks to be promoted by sensing the intermediate valueand changing the intermediate value by predetermined calculations, thenactivating the data transfer means for promoting the data stored in thenext baking store tracks.
 11. In a peripheral data storing system forbeing attached to a host processor and having interconnected cache andbacking stores, transfer means in the system coupled to said stores foraccessing same using the addresses of the backing store and fortransferring data with an attached host processor and between the twostores and indicating when the host processor is accessing the cachestore for either recording or reading data therein or therefrom, each ofthe stores having addressable data storing tracks of a given datastoring capacity;the improvement including, in combination: short datameans coupled to the transfer means and to the stores for controllinginter-store data transfers when the host processor is accessing datastored therein in a random accessing mode and including cache controlmeans coupled to the cache store for activating the transfer means totransfer data between the stores to encourage data to be read by thehost processor to be resident in the cache store and data to be writteninto the system to be written directly to the backing store; sequentialdata means coupled to the cache store and to said transfer means foractivating the transfer means to maintain in said cache store dataresiding in a number of said cache store tracks located within alocality of references, local means in said sequential means forindicating to the sequential means which of said backing store tracksreside within a locality of references for each of the cache storetracks currently being accessed for data transfer with the hostprocessor; long data means coupled to the cache and backing stores andto said transfer means for encouraging all data transfers to be directlybetween the host processor and the backing store; and mode control meanscoupled to said transfer means and to all of said data means formonitoring the lengths of individual ones of the data transfers betweenthe host processor and the cache store and responding to the monitoreddata transfer lengths in groups of cache store tracks accessible bycontiguous ones of the backing store addresses to establish saidlocalities of references and to actuate a respective one of the datameans to control data transfers between said cache and backing stores ofbacking store tracks bearing addresses within and adjacent to localitiesof references by respective ones of the data means such that the shortdata means controls the inter-store data transfers for short individualhost processor to system data transfers, the sequential data meanscontrols the inter-store data transfers for individual host processor tosystem data transfers which appear to be sequential and the long datameans limits and controls the inter-store data transfers forindividually long host processor to system data transfers.
 12. In a datastorage system having attachment means for attaching the system to ahost processor whereby data may be transferred between the hostprocessor and the system for storage and retrieval;a cache store in thesystem; a backing store in the system, data transfer means intercouplingthe attachment means, the cache store and the backing store so that datamay be transferred directly between either of the stores and theattachment means or between the two stores; a programmed controlconnected to said attachment means, the data transfer means and the twostores for sending control signals thereto and receiving command andstatus signals therefrom such that the programmed control controls theoperation of the system; the programmed control having a control storefor storing computer program indicia; the programmed control sensing theprogram indicia and responding to the sensed indicia to operate thesystem in accordance with the control indicia, the command signals andthe status signals; the stores having addressable data storing tracks ofequal data storage capacity; means in the programmed control to allocatepredetermined ones of the cache tracks to store data addressed forpredetermined ones of the backing store tracks; means in the cache storefor addressing the allocated cache tracks using the addresses of saidpredetermined respective ones of the tracks in the backing store,respectively; the improvement including, in combination: measuringprogram indicia in the control store for being sensed by the programmedcontrol for causing the programmed control to monitor the data transfersbetween the attachment means and the cache store including measuring thelength of each data transfer and storing the measured lengths includingsumming all measured lengths to create a stored access extent relatingto each of the allocated ones of the cache tracks; threshold indicia inthe control store for being sensed by the programmed control forindicating to the programmed control threshold values respectively forfirst thresholds of access extents in the respective cache tracks forindicating a possible sequential mode of operation and a secondthreshold greater than the first threshold for indicating data transfersexceeding a need for a sequential mode of operation in the system;access detection indicia in the control store for being sensed by theprogrammed control for causing the programmed control to respond to anattachment means explicit attempted access to each given cache track forinstituting a comparison of the stored measured length sums with saidthresholds; comparison indicia in the control store for being sensed bythe programmed control for causing the programmed control to respond tosaid instituted comparison to compare the stored measured length sum forsaid given cache track with said first threshold, if said comparisonindicates that the given cache track has a stored access extent sum lessthan or equal to the first threshold, then no sequential mode is needed,else if said comparison indicates that the given cache track has astored access extent sum greater than said first threshold, then settingan indicator that a sequential mode is possible for data transfersrelated to said given cache track and other predetermined cache tracksaccessible by addresses contiguous and less than the address of thegiven cache track; combining indicia in the control store for beingsensed by the programmed control for causing the programmed control torespond to said indicator being set to compare the stored access extentsums for said other predetermined cache tracks, respectively, andindividually with said first threshold, if not all of said otherpredetermined cache tracks are allocated to backing store tracks of ifany one of said other predetermined cache tracks have stored accessextent sums not greater than the first threshold, then causing theprogrammed control not to institute a sequential mode, else if all saidother predetermined cache tracks are allocated to respective backingstore tracks and all have stored access extent sums greater than thefirst threshold, causing the programmed control to indicate that asequential mode is to be set for the data transfers between theattachment means which include data transfers with said given cachetrack; and data promotion indicia in the control store for being sensedby the programmed control for causing the programmed control to senseand respond to the sequential mode indication for summing the storedaccess extent sums for said given and other predetermined cache tracksfor calculating a number of cache tracks that should be allocated tocertain backing store tracks for storing data therefrom wherein thecertain backing store tracks have backing store addresses contiguous andincreasing with respect to the given track address and the number ofcertain backing store tracks being said calculated number of tracks andthen causing the programmed control to actuate the data transfer meansto transfer the data from said backing store to said cache store for thecache tracks allocated for said certain backing store tracks wheneversuch tracks are either not allocated or do not contain the data of thecertain backing store tracks.
 13. In a data storing system havingattachment means for attaching the data storing system to a hostprocessor whereby data may be transferred between the host processor andthe data storing system for storage and retrieval;a random access cachestore in the data storing system; a rotating disk data storing device ina backing store in the data storing system; data transfer meansintercoupling the attachment means, the cache store and the backingstore so that data may be transferred directly between either of thestores and the attachment means or between the two stores; a programmed,control connected to said attachment means, the data transfer means andthe two stores for sending control signals thereto and receiving commandand status signals therefrom such that the programmed control controlsthe operations of the data storing system; the programmed controlincluding a control store for storing computer program indicia forsensing same and responding to the sensed indicia to send out saidcontrol signals and to sense and analyze said received command andstatus signals; the stores each having addressable data storing tracksof equal data-storage capacity; means in the programmed control storedcomputer program indicia to cause said programmed control to allocatepredetermined ones of the cache tracks to store data addressably storedfor predetermined respective ones of the backing store tracks; means inthe cache store for addressing the allocated cache tracks using theaddresses of said predetermined respective ones of the tracks in thebacking store; the improvement including, in combination: monitoringprogram indicia in the control store for being sensed by the programmedcontrol for executing computer programming contained in such indicia forcausing the programmed control for operating the system to monitor saiddata transfers between the attachment means and the cache storeaddressed ones of the allocated cache tracks for measuring the length ofdata in each such transfer and storing the measured data lengths, thensumming the measured data lengths for all data transfers between theattachment means and the respective cache tracks to create a storedaccess extent for each of the cache tracks allocated to store data;threshold indicia in the control store for indicating a threshold valueand being sensible by the programmed control for obtaining saidthreshold value; indicator means in the data transfer means forindicating a completion of a last data transfer between the cache storeand the attachment means and the backing store address for the cachetrack used in the data transfer; comparison program indicia in thecontrol store for being sensed by the programmed control for executingcomputer programming contained is such indicia causing the programmedcontrol to operate the system for sensing said completion indicator andresponding thereto sensing the stored access extents for the cache trackused in the last data transfer and for "K" cache tracks respectivelyaddressable by backing store addresses contiguous with the backing storeaddress for the last access cache track, then the programmed controlprocessing the sensed stored access extents using predeterminedcalculations to create an intermediate value is greater than thethreshold value, indicating a sequential mode of operation for datatransfers in said last accessed cache track, wherein "K" is an integer;and data promotion program indicia in the control store for being sensedby the programmed control for executing computer programming containedin such indicia for causing the programmed control to operate the systemfor sensing the sequential indicator, if the sequential indicator isset, then causing the programmed control to operate the system forpromoting data from next backing store tracks to cache store tracks withthe tracks having backing store address contiguous with and greater thanthe backing store address of said last accessed cache track, calculatingthe number of tracks to be promoted by sensing the intermediate valueand changing the intermediate value by predetermined calculations, thenactivating the data transfer means for promoting the data stored in saidnext backing store tracks.